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AMPLITUDE  DEPENDENT  ERRORS  IN 
THE  CALCULATION  OF  WIENER  KERNELS 

By 

Gary  Robert  Ellis 
March.  1977 

Chairman:  Dr.  Michael  E.  Warren 

Major  Department:  Electrical  Engineering 

The  calculation  of  Wiener  kernels  via  the  cross-correlation  methods 
of  Lee  and  Schetzen  for  use  in  nonlinear  system  identification  is  examined. 
The  calculated  kernels  are  shown  to  depend  upon  the  power  of  the  input 
approximating  a white  noise  probe.  This  dependence  is  due  to 
amplitude  related  nonlinearities  such  as  thresholds  in  the  system,  and 
is  also  a consequence  of  the  finite  computations  used  to  derive  the  kernels. 
Data  obtained  from  investigations  into  near  field  seismic  energy  propa- 
gation is  used  to  calculate  kernels  identifying  the  propagation  medium, 
and  the  effects  of  the  input  pov^er  level  on  the  calculated  kernels  are 
shown. 
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CHAPTER  I 


INTRODUCTION 


There  has  long  been  an  interest  in  discriminating  among  different 
types  of  seisnic  .energy  sources  via  detection  and  classification  of  the 
signals  they  emit.  This  has  generally  been  facilitated  by  using  linear 
models  for  seismic  propagation  channels.  Good  models  have  been  developed 
for  soii:e  cases,  such  as  earthquakes  or  underground  explosions,  where 
sensing  devices  are  at  a considerable  distance  from  the  source  (see  White, 
1965).  In  the  near  field,  however,  these  models  have  been  less  than  satis- 
factory.  Walker  (1976)  shows  this  is  at  least  partly  due  to  drastic 
nonlinearities  which  are  introduced  into  the  dynamics  of  the  near  field 
propagation  channel.  These  nonlinearities  result  from  the  coupling  over  a 
large  area  of  acoustic  energy  also  emitted  from  the  source  into  the 
seismic  propagation  medium,  and  they  must  be  identified  in  order  to  devise 
accurate  near  field  models  of  the  medium. 

Several  methods,  such  as  phase-plane  and  describing  function  techniques, 
are  available  for  nonlinear  system  analysis,  but  these  methods  are 
specialized  and  can  only  be  applied  to  narrow  classes  of  nonlinear  systems. 
Volterra  (1930)  was  the  first  to  suggest  a general  method  for  nonlinear 
system  analysis  when  he  introduced  the  concept  of  expanding  the  output 
of  a time  invariant  nonlinear  system  into  a series  of  multidimensional 
convolutions  known  as  Volterra  functionals 


y(t)“vlj  .••[  1„)x(t-T;)...x(t-Tjd,|...dl^  . 

I * —nm  * .no 


(1.1) 


From  this  concept  there  has  grown  a powerful  and  general  method  for 
characterizing  time  invariant  nonlinear  systems  known  as  the  Wiener 
Theory. 

Wiener  (1958)  showed  that  the  proper  probe  for  studying  such  nonlinear 
systems  is  a zero-mean  white  Gaussian  process.  He,  therefore,  modified 
Vol terra’s  representation  to 

to 

y(t)  = I G [h  ,x(t)]  , (1.2) 

n=0  " " 

where  the  G-functionals,  (G^).  are  a complete  set  of  orthogonal 
functionals  when  x(t)  is  a zero-mean  white  Gaussian  process: 

Gjh^,,x(t)]Gn[h^,x(t)]  = 0 , m/n  . (1.3) 

(The  overbar  indicates  the  time  average  over  the  interval  (-*,«).),  The 
functions  h^(7p...,T^)  are  known  as  the  Wiener  kernels  and  they  completely 
characterize  the  system.  Basically,  the  Wiener  theory  requires  the 
measurement  of  the  system  response  to  the  zero-mean  white  Gaussian 
input  probe.  Then,  due  to  the  orthogonality  of  the  G-functionals,  the 
mathematical  relationships  between  the  response  and  the  probe  can  be  used 
to  calculate  the  Wiener  kernels. 

Wiener  (1958)  presented  a method  for  making  this  calculation  that 
employs  a further  expansion  of  the  kernels  into  orthogonal  functions  such 
as  Laguerre  polynomials.  This  method,  however,  is  not  in  common  use,  since 
practical  considerations  do  not  permit  infinite  expansions  of  the  kernels. 
Kernels  calculated  in  this  manner  using  finite  expansions  approximate  the 
actual  kernels  in  a minimum  integral  square  sense.  In  addition,  Wiener's 
method  is  suitable  for  analog  implementation,  but  it  does  not  readily  lend 
itself  to  digital  implementation.  * 
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Lee  and  Schetzen  (196b)  introduced  an  alyorithn  for  determininy  the 
Wiener  kernels  which  employs  cross-correlation  techniques.  It  avoids 
the  expansion  of  the  kernels  into  orthoyonal  functions  which  is  essential 
in  Wiener's  method,  ai;d  allows  the  kernels  to  be  calculated  point  by 
point  for  simple  digital  implementation.  Other  algorithms  and  modi- 
fications to  the  Wiener  theory  have  been  presented.  French  and  Butz  (1973) 
proposed  an  algorithm  which  reduces  computing  time  with  some  loss  of 
high  frequency  information  through  the  use  of  Fast  Fourier  Transforms. 

Krausz  (1974)  modified  the  Wiener  theory  for  use  with  Poisson  distributed 
discrete  input  probes.  Promising  research  is  currently  underway  at  the 
California  Institute  of  Technology  by  Fender  (see  Brownell,  1976)  which 
employs  computational  ideas  similar  to  those  of  Krausz  to  construct  hardware 
that  very  efficiently  calculates  Wiener  kernels  for  certain  classed  of 
biological  phenomena.  A brief  review  of  the  Wiener  theory  and  especially 
the  method  of  Lee  and  Schetzen  which  is  employed  in  this  research  is 
presented  in  Chapter  II. 

Walker,  Constantine  and  Warren  (1976)  investigated  the  feasibility 
of  using  the  Wiener  theory  of  nonlinear  system  identification  to  develop 
near  field  models  for  seismic  energy  propagation  media.  The  models  thus 
devised  shov/ed  significant  improvement  over  the  linear  models  (see  Walker, 
1976).  During  this  investigation,  however,  it  was  noted  that  the 
calculated  kernels  displayed  certain  dependencies  upon  the  power  level  of 
the  input  probe.  Further  examinations  revealed  this  phenomenon  to  be  due 
to  both  the  amplitrde  related  nonlinearities  in  the  system  such  as  thresholds 
and  to  the  approximations  of  white  Gaussian  noise  used  in  the  actual 
processing  involved  in  calculating  the  kernels.  Since  the  kernels  are 
calculated  by  probing  the  system  at  a single  constant  power  level  the 
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amplitude  dependencies  due  to  the  .e  two  factors  reflect  themselves  as 


errors  in  the  kernels.  The  primary  focus  of  this  research  is  the 


examination  of  these  amplitude  dependent  errors  in  the  calculation  of 


the  Wiener  kernels. 


A yood  example  of  tiie  amplitude  dependencies  exhibited  by  the 


calculated  kernels  for  systems  with  thresholds  is  the  simple  limiter. 


Such  a system  will  appear  to  change  its  nonlinear  characteristics  depending 


upon  the  amplitucle  of  the  input  signal.  If  the  amplitude  is  small 


compared  to  the  threshold  of  the  limiter,  the  system  will  appear  linear. 


On  the  other  hand,  if  the  input  amplitude  is  large  con)pared  with  the 


threshold,  the  system  takes  on  the  appearance  of  a hard  limiter  which 


is  quite  nonlinear.  Even  though  the  algorithms  for  calculation  of  Wiener 


kernels  involve  normalization  with  respect  to  the  input  power  level,  the 


effects  of  such  amplitude  dependent  nonlinearities  will  be  reflected  in 


the  calculated  kernels  depending  upon  the  power  level  of  the  input  probe. 


This  particular  problem  together  with  the  errors  involved  in  approximating 


a Gaussian  white  process  are  discussed  in  Chapter  III. 


The  amplitude  dependencies  in  the  kernels  due  to  the  calculation 


processes  result  from  the  finite  as  opposed  to  infinite  computations  used 


to  derive  the  kernels.  The  Wiener  theory  requires  that  averages  be  taken 


over  infinite  intervals  which  also  implies  that  the  zero-mean  white 


Gaussian  input  probe  must  have  infinite  length.  This,  of  course,  is 


impossible  in  a practical  application  of  the  theory  and  infinite  intervals 


are  approximated  by  long  finite  intervals.  This  creates  a problem  when. 


during  the  course  of  calculating  the  kernels,  the  means  of  random  processes 


do  not  equal  their  sample  means  over  finite  intervals.  This  has  the  effect 


of  introducing  biases  into  the  input  probe,  and  as  discussed  by  Mannarelis 


W 


s 


(1972)  may  cause  considerable  errors  in  cases  where,  theoretically, 
terms  containing  the  average  of  the  process  should  drop  out.  This  problem 
is  discussed  in  Chapter  IV. 

Chapter  V presents  a practical  example  of  the  problems  which  are 
encountered  due  to  these  two  types  of  dependencies  when  calculating  the 
Wiener  kernels.  A seismic  energy  propagation  medium  was  probed  with 
zero-mean  white  Gaussian  processes  at  various  power  levels.  Kernels 
were  calculated  for  each  of  the  various  probes  used  and  the  effects  of 
the  probe’s  power  level  on  the  calculated  kernel  are  discussed.  Chapter  VI 
contains  a summary  of  the  results  of  this  research  and  suggestions  for 
further  work  in  this  area. 

t 


CHAPTER  II 


REVIEW  OF  THE  WIENER  THEORY 

The  problem  of  findimj  the  relationship  that  determines  the  output 
of  a system  in  response  to  any  relevant  input  is  known  as  system 
identification.  A variety  of  well-known  techniques  exist  for  the 
identification  of  linear  systems,  but  identification  techniques  applicable 
to  broad  classes  of  nonlinear  systems  are  lackinq.  Several  methods  for 
nonlinear  system  identification  are  available,  such  as  phase-plane  and 
describing  function  techniques,  but  they  have  serious  limitations  and 

I 

are  useful  only  for  narrow  classes  of  systems.  There  is,  however,  a 
fairly  general  theory  which  has  grown  from  the  work  in  this  area  by 
Morbert  Wiener. 

Volterra  (1930)  introduced  an  input-output  relationship  as  a 
series  of  multidimensional  convolutions  (see  eqn.0 . 1) ) . Prompted  by 
Vol terra's  work,  Wiener  (1958)  laid  the  foundation  for  a general  theory 
for  nonlinear  systems  by  demonstrating  that  the  proper  probe  for  studying 
such  systems  is  a zero-mean  white  Oaussian  process.  With  this  in  mind, 
he  modified  the  Volterra  series  to 

y(t)  = )'  G^[h^.x(t)]  , (2-1) 

n=0 

where  IG^}  is  a complete  set  of  functionals  which  are  orthogonal 
(see  eqn.  (1 .3))  when  x(t)  is  a zero-mean  white  Gaussian  process.  Each 
G-functional , G , is  the  sum  of  the  nth  degree  hoijiogeneous  functional 


r 


» • • 


(2.2) 


1 

1 

] 


...  I h^(ij,....i^^)x(t*i.)...x(t-i  )dt  ...di 

) ..>1.  ) sCO  ^ 


and  other  homogeneous  functionals  of  degree  less  than  n whose  kernels 
are  derived  in  a systematic  manner  frotii  h^(T  j ,. . . ,t^)  , such  that  for 
a zero-mean  white  Gaussian  input  probe,  x(t),  is  orthogonal  to  all 
G-functionals  of  degree  less  than  n.  This  can  be  seen  in  the  first 
four  G-functionals: 


GoLhQ,x(t)]  = h^ 


G^th^,x(t)]  = 


h^ (i )x( 


• cn  f ft> 

G2[h2,x(t)]  = h2(T^ ,1 

J •oo'  -m 


G3[h^,x(t)]  = 


t-i  )di  , 


2)x(t-T 
1 ’’2*^3 

1 ”2’^2 


I )x(t-T 
)x(t-T^ 

)x{t-T^ 


( "" 

2)dr^dr2-K  h2{TpT^)dTp 

< 

)x(t-t2)x(t-T2)dT  ^dT2<iT2 
Idt^dT^,  (2.3) 


where  the  power  density  spectrum  of  the  input  probe,  x(t),  is 
t (f)  = K. 

XX 

In  this  formulation,  the  Wiener  kernels,  th^},  completely  characterize 
a time- invariant  nonlinear  system  if  its  memory  asymptotically  approaches 
zero  for  the  infinite  past.  Due  to  the  orthogonality  property  of  the 
G-functionals,  the  Wiener  series  may  be  truncated  after  n G-functionals, 
giving  the  best  nth  order  polynomial  nonlinear  approximation  to  the  system 
output  in  the  sense  of  least  integral  square  error.  Higher  order 
functionals  are  independent  and  can  be  added  later  without  affecting  the 
estimate  of  G-functionals  already  obtained.  So  tjie  problem  of  system 
identification  becomes  the  problem  of  detenitining  the  Wiener  kernels. 


r 

Wiener  accomplished  this  by  expanding  the  kernels  in  terms  of  a set 
of  orthogonal  functionals;  he  used  the  Laguerre  functions  in  particular. 
Thus,  the  identification  process  is  further  reduced  to  determining  the 
coefficients  of  this  expansion.  Since  the  Laguerre  functions  can  be 
represented  by  a series  of  phase-shift  electrical  networks,  the  coefficients 
can  be  determined  by  a system  of  physical  measurements.  This  method  is 
suitable  for  analog  measurements,  but  it  does  not  readily  lend  itself  to 

r 

I digital  computations.  Practical  considerations  require  the  kernels  to 

I be  expanded  in  terms  of  a finite  series,  which  will  introduce  truncation 

! , errors.  Although  these  errors  are  minimum  integral  square  errors 

associated  with  the  expansion  on  a finite  orthogonal  set,  they  are  still 

I prohibitive  in  most  practical  applications  of  the  Wiener  theory. 

i 

' Lee  and  Schetzen  (1965),  however,  introduced  a method  of  determining 

the  Wiener  kernels  which  employs  a cross-correlation  algorithm.  It 
avoids  the  expansion  of  the  kernels  which  is  essential  in  Wiener's  method, 
and  the  kernels  can  oe  calculated  point  by  point  for  simple  digital 
implementation.  The  method  uses  a set  of  functionals  that  are  formed  by 
passing  a zero-mean  white  Gaussian  process,  x(t),  through  a system  of 
parallel  delay  circuits  and  multiplying  their  outputs.  This  yields 

y^(t)  = x(t-T,)...x(t-,J  (2.4) 

^ fT>  ( ^ 

= J ...  J (S((i^-t^)---(S(a^-i^)x(t-o^)...x(t-nj^)da^...d(5^  . 

I The  integral  is  a homogeneous  functional  of  nth  degree;  therefore,  the 

product  of  yj^(t)  3nd  the  response  of  an  unknown  system  to  the  same  x(t) 
can  be  averaged  to  determine  the  nth-order  Wiener  kernel,  h . 

i 

i 

I , 
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Consider  an  unknown  time-invariant  nonlinear  system,  S,  with  a 
zero-mean  white  Gaussian  input  probe,  x{t),  and  output,  y(t).  The 
zeroth-order  Wiener  kernel,  h^,  is  simply  the  time  average  of  the  output, 
y(t).  The  first-order  Wiener  kernel  is  measured  by  applying  x(t)  to  the 
unknown  system  which  yields  y(t)  and  a delay  circuit  to  form  y^(t). 
Multiplying  y(t)  and  y^(t)  and  averaging  the  product  gives 

on 

"yTtTy I’CtT  •=  ( 5^  g [h  ,x(t)]}x(t-T)  . 

' n=o  " " 

Since  y^(t)  results  from  a functional  of  the  first  degree,  the  G-functionals, 
for  n'l,  are  orthogonal  to  x(t-i).  So  we  have 

_ 

y('t)yirt)  = { I G^[h^^,x(t)]}x(t-T)  . 

n=0  ( 

For  n=0  we  have 


Go[ho.x(t)]x( t- 1 ) = h^x(t-T)  = 0 , 


since  x(t)  is  zero-mean.  Hence 


y{tjyi(t)  = [ 


h.|  (o)x(t-a)da]x(t-T ) 


h.|  (a)x  (t-o)x(t-Tildo 

J -on 

M CO 

h^  (o)K(S(  i-a)da 

. —CO 


= Kh^(T)  . 

Therefore,  we  obtain 

h^(i)  = y(t)x(t-7)  . 


I 


I 


(2.5) 


10 


The  first-order  Wiener  kernel,  then,  is  the  cross-correlation  of  the 

output  and  input  divided  by  the  power  level  of  the  input  of  the  unknown  system 

when  probed  with  a zero-mean  white  Gaussian  process. 

The  second-order  Wiener  kernel  is  measured  in  the  same  manner: 


y(t)yp(t)  = { I G [h  ,x(t)]}  x(t-T, )x(t-Tp) 
n=0 


but  y2(t)  results  from  a second  degree  functional,  so 


y(t)y2(t)  = { I G^[h^,x(t)]}  x(t-T^)x(t-T2) 
n=0 


For  n=0  we  have 


Go[ho,x(t)]x(t-Ti  )x(t-T2)  = h^x(t-T^  )x(t-i2)  ^ ’ 


and  for  n=l 


G|Lh'^\xU)  JxTt-tYU'Ct-fp  = [j  h^(o)x(t-o)do]x(t-T^)x(t-T2) 


= h^ (o)x(t-o)x(t-T^ )x(t-i2)do 


= 0 , 


since  the  average  of  the  product  of  an  odd  number  of  zero-mean  Gaussian 
variables  is  zero.  Finally,  for  n=2 


G2[h2iX(t)]x(t-T^ )x(t-r2)  = [ 


h2(o.j  ,02)x(t-n^  )x(t-02)d<3ido2 


-K|  h2(a2.02)do2]x(t-ipx(t-T2) 


2 f "” 

-K  (S(r^-i2)J  ^2^°2’®2^‘^^2 

2 f ” 

= K [6(t^-T2)J  h^io^  ,0^  )da^+h2(Tp-t2) 

' -00 

= 2K^h2(T^ ,12)  . 


Therefore 


y(t)y2(t)  = y(t)x(t-T^ )x{t-T2)  = 2K^h2(T^ ,T2)+h^K6(T^-T2) 


h2(>i»i2^  ^ '~2  ^1  ^ ^2  ' 

2 K 


The  general  result  for  measuring  the  Wiener  kernels  is 


(2.6) 


h (t  ,...,T  ) = — -- y(t)y  (t)  = -— - y(t)x(t-T,)...x(t-T  ) , (2.7) 

n I n ^,|^n  n ^j,^n  I n 

except  when  two  or  more  t's  are  equal.  This  final  restriction  is  not 
severe  because  we  can  come  arbitrarily  close  to  these  points  in  practical 
applications.  Lee  and  Schetzen  (1965),  however,  present  a method  which 
will  remove  the  restriction  with  a small  amount  of  difficulty.  Take  for 
example  eqn.  (2. 6) whore  the  restriction  first  appears.  The  restriction 
occurs  because  the  second  term  is  assumed  to  be  zero  which  is  not  necessarily 
true  when  = I2  • This  term  results  from  the  portion  of  y(t)  . Since 
has  already  been  determined  when  h2  is  calculated  it  can  be  subtracted 
from  y(t)  to  eliminate  the  second  term.  The  result  is 


(2.8) 


r 


h2(r^.i2^  ""  2 

2K 


which  is  valid  for  all  and  general  we  have 

h„(’l ly(t)-  I G„[h  ,*(t)])  y (t)  . (2.9) 

n I n ni  ni  n 

In  either  case  the  multidimensional  cross-correlations  required  to 
determine  the  kernels  are  straight  forward  and  simple  to  program.  The 
Lee  and  Schetzen  algorithm  is  used  to  determine  the  Wiener  kernels  in 
this  research. 


CHAPTER  III 

ERRORS  DUE  TO  FINITE  POWER  WHITE  NOISE  APPROXIMATIONS 

The  Wiener  theory  requires  that  the  system  to  be  identified  be  probed 
with  a zero-mean  Gaussian  white  noise  process.  Since  white  noise  has 
infinite  power  it  is  impossible  to  construct  such  a probe  in  a physical 
application  of  the  theory.  In  practice  a white  noise  process  is 
approximated  with  a finite  power  signal  that  is  nearly  white  over  the 
bandwidth  of  the  system  to  be  identified.  However,  this  approximation 

leads  to  errors  in  the  calculated  kernels.  For  digital  implementations 

( 

a piecewise  constant  independent  increment  white  noise  approximation  is 
typically  employed.  This  approximation  in  particular  introduces  errors 
into  the  calculated  Wiener  kernels  that  are  dependent  upon  the  bandwidth  of 
the  approximation,  and  for  certain  types  of  nonlinearities  such  as  thresholds, 
the  errors  also  exhibit  a dependence  upon  the  powe*"  of  the  white  noise 
approximation.  For  simple  nonlinearities  these  errors  can  be  described 
parametrically  and  by  doing  so  some  insight  can  be  gained  into  how  they 
arise  and  the  effects  they  have  upon  the  calculated  kernels. 

The  Whi te_ Noise  Approximation 

A comprehension  of  the  independent  increment  white  noise  process  and 
its  implications  is  essential  to  understanding  these  errors.  The 
approximation  is  rarely  discussed;  therefore,  the  following  description 
is  presented  before  continuing.  Samples  of  the  process  are  constructed 
by  randomly  choosing  values  from  a zero-mean  GausSian  distribution  with 
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variance  o , and  then  holdiny  the  process  constant  equal  to  this  value 
over  an  incretnent  in  time  of  length  T.  Additional  points  are  chosen 
independently  from  the  Gaussian  distributed  set.  Thus  a series  of 
incremental  steps  with  width  T and  independent  zero-mean  Gaussianly 
distributed  amplitudes,  a^,  is  formed: 


^ n!!!!  I a^[U|  (t-nT)-u,  (t-nT-T)], 
n=-N 


(3.1) 


where  u^(t)  is  a generalized  step  function. 

The  starting  times  of  the  increments  in  the  approximation  are  not 
critical  in  this  application  as  long  as  their  length  is  always  T.  Assuming 
the  starting  times  in  different  sample  functions  of  the  approximation  are 
uniformly  distributed  over  time,  the  white  noise  approximation  is 

I 

ergodic.  The  autocorrelation  is 


= x(t)x{t-T) 


Making  this  calculation  gives 


N N 

^xx^”^^  " NX-  ^ a^a^[u^{t-nT)-u^(t-nT-T)][u^(t-mT-T)-u^{t-mT-T-T)] 

n=-N  m=-N 


N N 


I )'  a a [u  (t-nT)-u, (t-nT-T)][u  (t-mT-1 )-u,(t-mT-T-T)] 
. M HI  n ni  I » I I I 


n=-N  m=-N 


Calculating  the  area  under  the  product  of  the  step  functions  and  dividing 


by  the  total  record  length  (2N<-1)T  gives 


R (t  ) = 
xx'  ' 


1 ill! 

1 

N *>«> 

■{2NViyr 

1 i in 

1 

N ►<" 

(2>i+y)T 

0,  elsewhere 

1 im 

1 

Nko 

UnhIt  , 

N N 

):  j 

n=-N  m=-N 

N N 

)■  )■ 

n=-N  ni=-N 

N N 


R (t)  = 

XX ' ' 


Now  let  n=i+m,  then 


J J a a [T-|mHT-nT|],  |niT+TnT|<T 
=-N  m=-N  " 

, |mT+T-nT|-T 


R (t  )= 
xx' 


, . , N-m  N 

N>-  (■2N+1')T  . I (T-h-iT|)  , |t-iT|<T 

i=N-m  ni=-N 

0 , |T-iT|-T  . 


Since  a^^^^  is  independent  of  except  when  i=0  in  which  case  they  are  equal, 
lim  ^ 

NhI  I ^i+m^m  = 0 for  i 0;  therefore  we  have 
ni=-N 


N «•  {2N+iyT  ^ ’ I i 


, I rr-T 


, , J t L 1 i iti  1 r 2 I I T 
(1-  N->„.  Y2N+1) 


. hl-T 


R (t  ) = 

XX ' ' 


,T^(1-  |t|<T 


0 , |r|^:T  . 


(3.2) 
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This  is  a triangular  pulse  centered  at  the  origin  with  amplitude  o and 
duration  2T.  The  power  spectrum  1'(f)  of  the  approximation  is  the  Fourier 
transform  of  R „(t ) 

4-(f)  = (— (3.3) 

2 

As  a check  't(f)  can  be  integrated  over  all  frequency.  The  result  is  o 

which  is  the  expected  power  of  the  underlying  Gaussian  process. 

It  is  not  necessary  to  assume  a uniform  distribution  of  the  increment 

starting  times  to  get  this  result.  Assume  the  starting  times  are 

identical  for  all  sample  functions  of  the  white  noise  approximation.  In 

this  case  the  problem  is  complicated  by  the  fact  that  the  function  is  no 

longer  ergodic.  (It  is  easily  seen  that  <x(tpx(t2)>  is  not  simply  a 

function  of  tp-t^.)  To  arrive  at  an  expression  for  the  power  distr.ibution 

of  the  white  noise  approximation,  extended  definitions  of  correlation 

functions  and  power  spectra  which  were  developed  by  Lampard  (1954)  are 

invoked.  Consider  the  energy  spectrum,  E(f),  of  the  independent  increment 

white  noise  approximation  up  to  time  t=NT.  Now  examine  the  incremental" 

increase  in  the  energy  spectrum,  Ei.(f),  that  occurs  when  the  process 

2 

continues  to  (N+1)T.  There  is  an  increase  of  for  an  average  increase 

2 

of  a T,  in  the  total  process  energy  every  T seconds.  The  increase  is 
distributed  as  the  energy  spectrum  of  a square  pulse  with  an  average 
ampl i tude  of  a, 

E^(f)  = o^(T  . (3.4) 

Power  can  be  defined  as  the  time  rate  of  change  in  energy.  By  extending 
this  definition  to  the  power  and  energy  spectra  and  knowing  the  increase 
in  E(f)  is  E^(f)  every  T seconds,  we  have  * 


I 

I 


r 


I / 


lAf) 


= o^T 


/SiniifT  i2 

'-'nTT  > 


This  is  the  same  result  as  obtained  in  eqn.  (3.3)  above.  Notice  the 

problem  is  considered  in  increments  of  T,  this  implies  an  "incrementally 

ergodic"  function.  It  is  not  necessary,  however,  to  use  a starting  titne 

of  NT  in  determining  E.|.(f);  it  is  simply  convenient  to  do  so. 

The  half-power  points  for  ^{f)  are  approximately  1 — . Choosing  T 

small  enough  will  extend  the  bandwidth  of  the  approximation  to  cover  the 

bandwidth  of  the  system  under  investigation.  If  this  is  done,  the  independent 

increment  process  described  approximates  relative  to  the  unknown  system, 

2 

a zero-mean  Gaussian  white  noise  with  a power  level  of  i’{0)=a  T.  The 

2 

calculated  kernels,  therefore,  should  be  noniialized  with  K=a  T.  This 

expression  reveals  some  of  the  effects  which  the  white  noise  approximation 

2 ' 

has  upon  the  calculated  kernels.  If  o is  taken  to  infinity  and  T is  taken 

2 

to  zero  such  that  K=o  T remains  constant,  it  can  be  seen  from  eqn.  (3.3) 

that  ideal  white  noise  will  be  achieved.  The  expression  above  can  be 

rearranged  to  1=  —r  . In  this  form  it  can  clearly  be  seen  (see  Fig.  I , 

2 

T vs.  o ) that  the  value  of  K is  arbitrary  in  determining  the  Wiener  kernels. 

2 

Taking  the  limit  as  o goes  to  infinity,  or  as  T goes  to  zero,  they  imply 
the  same  thing,  the  lines  for  various  values  of  K converge  on  each  other. 

This  is  reassuring  since  the  development  of  the  Wiener  theory  does  not 
suggest  a dependence  of  the  kernels  upon  K. 

Problems  sometimes  arise  in  choosing  a value  of  K,  however,  in  physical 
applications  of  the  theory.  The  calculated  kernels  are  actually  statistical 
estimates  of  the  true  kernels  and  they  have  some  variance  associated  with 
them.  This  fact  imposes  certain  restrictions  on  T which  are  discussed  by 
Marmarelis  (1972).  T must  be  chosen  small  enough  such  that  the  bandwidth 

I 

of  the  white  noise  approximation  is  greater  than  the  bandwidth  of  the 
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unknown  system,  but  if  it  is  chosen  too  small  Marmarelis'  work  indicates 
that  the  variance  of  the  estimated  kernels  becomes  excessive.  Therefore, 
a value  for  T is  usually  set  early  in  the  identification  process.  With 
this  constraint  on  T there  is  no  guarantee  that  the  calculated  kernels 
are  independent  of  the  choice  of  K (see  the  T=T^  line  in  Fig.  1).  For 
some  nonlinearities  such  as  the  simple  limiter  it  can  be  shown  that  the 
calculated  kernels  are  dependent  upon  K when  T is  constrained.  This  in 

2 

effect  means  that  the  calculated  kernels  are  dependent  upon  the  power,  o , 
of  the  approximate  white  noise  input  probe  and  therefore  errors  in  the 
calculated  kernels  are  also  dependent  upon  the  power  of  the  input  probe. 
Since  the  instantaneous  power  of  a signal  is  related  to  the  amplitude  of  the 
signal  and  the  errors  in  the  kernels  usually  become  evident  as  the  amplitude 

I 

of  the  input  to  the  modeled  system  is  varied,  the  term  amplitude  dependent 

2 

error  is  used  to  denote  the  dependence  of  the  errors  upon  o . 

Aiiipl  i tude  Dependent  Error  Analysis 

The  limiter  is  a graphic  example  of  the  dependence  of  the  calculated 
kernels  upon  the  power  of  the  input  probe.  Since  all  physical  systems 
contain  a limiter  of  sorts,  it  is  also  a very  practical  example.  Consider 
the  simple  ideal  limiter: 


-1  , x{t)^  -1 

y(t)  ^ <x(t)  , |x(t)l^i 
1 , x(t)-l 


(3.5) 


Let  us  probe  the  system  with  an  independent  increment  white  noise  approximation, 
x(t).  The  zeroth-order  Wiener  kernels  is 

ho  = y(t)  = 0 . ' (3.6) 


U.  . 
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Thp  amplitudes  of  the  different  increments  of  a sample  function  of 
x(t)  may  be  viewed  as  an  ensemble  of  points  from  the  Gaussian  distribution. 
The  first-order  Wiener  kernel  is 
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h^d)  = -,^y(t)x(t-r) 
,-l 


[- 


xe 


0^2  2 J 


I 


:iio 

0 


J-1 


dx+ 


xe'^  Wx][i- 


For  notational  convenience  the  following  triangular  pulse  is  defined: 

0,,)  J |[|'- • I'I<' 


0 , |T|--T 


(3.7) 


Notice  that  D(t)  approaches  the  Dirac  delta  function  as  T approaches  zero. 
Combining  the  integrals  gives 


2 rf’  .2„-x2/2o' 


o 72n  •'0 


2 ^ 
/o  _ 


f C / o 

hdi)  = t ^ ^ /2y(jx]  D(t) 

• J in  I n J 1 


Making  a change  of  variable,  x*-  — , we  have 


(,)  . [ dx.  .-2:=  f"  xe-*‘^'dx  ] 0(,)  . 


’v/2it  jo 


oJZv  J 1 /o 


Finally,  separating  the  integral  into  a form  that  is  commonly  tabulated 
yields 

hi 


(,)  = [[  (x2-l)e‘’^  /^dx+  e"’^  /^dx+  - [ xe'^  /2,x]d(i) 

/2ir  ■’O  Jn  ® Jl/ft 


0 


l/a 


The  integrand  of  the  first  integral  is  a perfect  differential. 


2 2 

d(-xe"’^  /^)  = (x2-l)e—  . The  second  integral, is  the  cumulative  distribution 


The  calculated  first-order  kernel  is  obviously  dependent  upon  the 
2 

choice  of  o and  T.  In  general  it  is  difficult  to  accurately  describe 
these  dependencies  from  experimental  data.  They  are  usually  complicated  and 
they  can  change  significantly  with  slight  changes  in  the  system  configuration. 
Consider 
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\ - 0 

h (,)  = .1  J„.  [[  ° 

- w 


(3.11) 

(l-e'^^^)xe''‘^''^‘'^dx]D(i) 
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dx-j  xe 


dx]  D(t)  . 
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/4a  >1 


Making  a change  of  variable  on  the  first  integral  of  x y — ^ — x and  on 

J 20^ 

the  second  integral  of  x gives 


'72 


u ^ ^ 2 r 2a 

■ 7/2.-  '47.1 
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(3.12) 


(-1+e  )x  e 
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2x^  2 -xV2a^,.^  [ - , -2x^  2 -x^/2o2 


dx+ I (1-e  )x 
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^2  ^ ^1  ’ ^2  ^ ~ ^ " 


(3.13) 


Comparing  these  results  with  those  of  the  simple  limiter,  it  can  be 
seen  that  there  are  large  differences  between  the  dependence  of  the  calculated 
first-order  kernel  upon  the  input  probe  power.  The  systems  are  very 
similar,  however.  In  the  limit,  as  the  input  approaches  white  noise  the 
first-order  kernels  for  each  limiter  goes  to  zero  as  7 _ 

Another  problem  with  identifying  the  nature  of  these  dependencies 
can  be  seen  when  the  simple  limiter  is  assumed  to  be  a physical  unknown 
system  to  be  identified.  The  power  of  the  input  probe  must  now  be 
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2 . 

specified.  Assume  o =0.01  is  used;  then,  tlie  calculated  kernels  are  to 
four  places 

h = 0 
0 

h^(T)  = 1.0000D(i) 

Obviously,  the  kernels  would  have  to  be  calculated  many  times,  with  each 

calculation  providing  one  point, in  determining  the  kernels  dependence  upon 

2 

o 

2 

The  question  now  arises  as  to  what  value  of  o should  be  chosen.  The 

2 

kernels  calculated  above  with  a =0.01  predict  that  the  system  output  is 

approximately  equal  to  its  input  (see  eqns.  (2.1)  and  (2.3)).  This  is  a 

valid  prediction  for  inputs  which  are  as  small  as  the  input  probe.  * However, 

for  inputs  with  amplitudes  much  greater  than  one,  say  10,  the  prediction, 

and  therefore  the  calculated  kernels,  is  grossly  inaccurate  since  the 

output  can  never  exceed  one.  The  amplitude  dependent  errors,  then,  are  a 

result  of  not  only  the  dependence  of  the  calculated  kernels  upon  the  input 

power  probe  but  also  of  the  instantaneous  power  of  system  inputs  relative 

to  the  power  of  the  input  probe  used  to  calculate  the  kernels.  The  closer 

they  are  to  each  other  the  better  the  prediction  will  be. 

The  solution  to  this  problem  is  to  use  an  input  probe  with  a power 

that  is  roughly  equivalent  to  the  instantaneous  power  of  typical  or 

interesting  inputs  to  the  system,  but  this  is  not  always  possible  if  these 

values  vary  significantly.  Sometimes  wide  variations  can  be  tolerated; 

2 

for  example,  the  kernels  of  the  simple  limiter  calculated  with  o =0.01 
yield  valid  predictions  of  the  outputs  for  any  inputs  with  magnitudes  less 
than  0.1.  On  the  other  hand,  a very  small  variation  can  cause  very  large 
errors.  Consider  the  differences  in  the  first-order  kernel  for  the  simple 
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2 2 
limiter  when  o is  allowed  to  vary  slightly  around  one.  For  o =0.8, 

h^ ( I )=0. 737D( 1 ) , and  for  0^=1. 2,  h| (i )=0. 637D( i ) . This  is  a difference 

of  15. 7X  for  a moderate  change  in  the  input  probe  power.  In  this  case, 

many  sets  of  kernels  would  have  to  be  calculated  with  various  values  of 
2 

0 before  good  accuracy  could  be  achieved  in  making  system  output  pre- 
dictions. This  approach  is  the  only  approach  currently  available  for 
reducing  the  significance  of  these  types  of  amplitude  dependent  errors  in 
the  calculated  Wiener  kernels. 


t 


I 
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CtlAPTER  IV 


ERRORS  DUE  TO  FINITE  RECORD  LENGTHS  . 

The  Wiener  theory  requires  that  averages  implied  by  the  cross- 
correlations used,  to  calculate  the  kernels  be  taken  over  the  interval 
(-00,00),  but  in  physical  applications  these  averages  can  only  be  taken 
over  a finite  interval.  This  causes  errors  since  the  sample  means  of 
finite  intervals  of  a random  process  are  not  generally  equal  to  the  true 
mean  of  the  process.  Unfortunately,  this  situation  is  inherent  in  the 
kernel  calculations.  These  induced  errors  are  statistical  in  nature  and 

I 

they  can  only  be  estimated.  Since  Gaussian  processes  are  used  to  calculate 
the  kernels,  the  variance  of  the  computed  kernels  from  the  true  kernels 
gives  a measure  of  the  error. 

The  manner  in  which  these  errors  arise  can  be  illustrated  with  a simple 
example.  Consider  a squarer: 


y(t)  = X (t) 


(4.1) 


This  system  does  not  exhibit  the  amplitude  dependent  errors  discussed  in 
Chapter  III.  Before  calculating  the  kernels  for  the  squarer  the  average 
of  an  iterated  product  of  a Gaussian  random  variable  is  given: 


n ^ 


' 2 2 
n -X  /2o  , 

X e dx 


n -X  /2  , 

X e dx 


, odd  n 

I '[1  • 3- 5. . . (n- 1 ) ] , even  n . 

0^ 


(4.2) 


.'(■) 


For  notational  convenience  the  following  definition  is  presented: 

1 ^ ' 1 I I ' 2 ^ 

-'2  (1 j'-  - — j— ) ,-T<  t^<0<i2<T  or  -T<i2<0<i^<T 


D( 


(4.3) 


1 hi  I 

2 T -T<i^-r2-0  or  0-i2-i^<T 


1 , >’2h  ' - •-  < 

’ 2 0-Tj-T2<T 


0 , elsewhere 


Notice  the  similarities  to  D(t)  (see  eqn.  (3.7));  this  function  is  related 
to  two-dimensional  cross-correlations  of  the  independent  increment  white 
noise  approximation,  x(t).  It  is  a pyramidal  pulse  with  volume  one,  and 
as  T approaches  zero  it  approaches  a two-dimensional  generalization  of  the 
Dirac  delta  function.  i 


The  first  three  Wiener  kernels  can  now  be  expressed  as  follows: 


h^  = y(t‘)  = x^(t)  = x^  = 


h^(7)  = j^-  'y(t)x(t-T) 

= I-  x^(t)x(t-T) 
o^T 

a 


(4.4) 


(4.5) 


h2(T^.'2^  " 2K  ^’'^^■^2^ 

= — y--p  [x^(t)-o^]x(t-T,  )x(t-T„) 

2((i  T)'^ 

= • I -2  [x^(t)x(t-t^ )x(t-T2)-o^x(t-T^ )x(t-T2)] 
2a  T 


Consider  the  case  where  x(t-T^)  is  independent  of  xlt-t^)  but  either 
or  both  may  or  may  not  be  independent  of  x(t).  Then  we  can  write  the 
equation  as 

h2(>]«t2^  = [x  (t)x(t-T^ )x+x  X (t)x(t-T2)  + x xx-o  xx]  = 0 , 

since  x is  a zero-mean  process.  For  the  case  where  x(t-T^)  and  xlt-r^) 
are  dependent  but  either  or  both  may  be  independent  of  x(t)  we  have 

h2(r^.T2)  = 2 4j‘2  x(t-T^  )x(t-T2)-a  x(t-T^  )x(t-T2l]  = 0 . 

This  leaves  the  case  where  x(t-T^),  x(t-T2)  and  x(t)  aremutually 
dependent: 


] 2 2 - 

112(1^, T2)  = -^-4-^2  (t)x(t-T^  )x(t-T2)  - O x(t-T^Tx(t-Tp'] 


1 r"4  . 

— [x  -O  X JD(t,  ,T„) 

2a^  ' 


= [3o^-o‘^]0(t,  ,Tp) 

2o  ' 

= D(t^ ,12)  . 


Summing  the  contributions  of  all  three  cases  yields 


112(1^  ,12)  = D{t^  .r^)  . 


(4.6) 


Remembering  that  T is  assumed  to  be  fixed,  the  variances  of  the 
strengths*  of  the  estimated  kernels,  denoted  by  var[h^],  will  give  a measure 
of  the  error  in  the  estimated  kernels. 


★ 

For  the  continuous  time  case,  the  kernels  of  a simple  nonlinear  amplifier 
will  consist  of  impulses;  hence  the  use  of  the  term  strength.  For  our 
independent  increment  white  noise  approximation,  the  kernel  is  effectively 
smeared,  and  the  integral  of  the  smeared  kernel  equals  the  strength  of 
the  continuous  time  kernel. 


^8 


2 ^ 

var[hp]  = ^ varCx^]  = J (x’-x^  ) = , (4.7) 

where  M is  the  number  of  independent  samples  used  to  calculate  the 

kernels,  which  is  just  L/T  where  L is  the  duration  of  the  sample  input. 

1 3 

var[h^]  = varC^^J 

= \ (?  - /) 

Mo 


_ .15o^T 


, 4 2 2 

varLhp]  = ii  var[--'- j--] 

^ 2o^ 

1 ,“8  T 2 '6  M 4 “4  ~2  '2^ , 

= p (x  -2a  X +0  X -X  -o  X ) 

4Ma^ 

= — — -p  ( 105(j^-30a^+3o^-4o^) 

4M3® 


(4.8) 


- 37T 
2L 


(4.9) 


Viewing  eqns.  (4.7)-(4.9),  some  conclusions  regarding  the  accuracy  of 
calculated  kernels  can  be  made  for  simple  nonlinear  systems  such  as 
y(t)=x^(t)  for  some  integer  n.  We  could  continue  in  a like  manner  to 
determine  the  variance  of  h2,h^,  etc.  for  the  case  n=2.  Doing  so  shows 
that  var[h^i]  is  proportional  to  In  the  general  case,  y(t)  = x'^(t), 

it  is  found  by  a similar  analysis  that  var[h^^]  is  proportional  to 

2(n-iii) 

o . 

We  note  from  eqn.  (4.9)  that  the  variance  in  the  estimate  of  ^2  is 
2 

independent  of  0 , the  power  of  the  input  probe,  and  in  general,  for 
y(t)=x"(t),  var[h^]  will  be  independent  of  0^.  The  variances  of  lower 
order  kernels  increase  exponentially  in  o with  a’decrease  in  the  order 
of  the  kernel  , while  higher  order  kernels  exhibit  a variance  that  decreases 


w 


2 

exponentially  in  o with  an  incre.ise  in  the  order  of  the  kernel. 


2 

Thus  for  a fixed  T,  the  choice  of  input  power  o , will  greatly 
effect  the  accuracy  of  estimated  kernels.  It  is  clear  that  large 
o,  o>l,  will  lead  to  the  likelihood  of  increased  error  in  low  order 
kernels,  whereas,  small  o,  o<l,  will  decrease  these  errors  while  increasing 
the  variance  of  higher  order  kernels. 

2 

The  relative  exponential  increase  in  o of  the  variance  of  some  of  the 
kernels  presents  a disturbing  computational  problem.  The  errors  associated 
with  these  kernels  may  be  proportionately  much  larger  than  that  associated 
with  other  kernels,  as  a result  of  the  increased  variance.  Hence  such 
calculated  kernels  may  seem  to  contribute  significantly  more  to  a modeled 
system  than  the  true  kernels  contribute  to  the  underlying  true  system, 
leading  an  experimenter  to  draw  false  conclusions  about  the  system  'under 
investigation. 

This  phenomenon  may  be  seen  by  substituting  some  numbers  into  the 

2 

example  of  the  squarer.  Assuming  T=1 , L=1000  and  o =100  we  have  var[h^]=20, 

var[h^]=1.5  and  var[h2]=  assuming  that  there  is  an  error  in 

the  calculated  kernels  of  plus  one  fourth  of  a standard  deviation  where 

h =100  yields 
0 

% ^ 101 

h,(T^)  = 0.32  D(t) 

h2(  ,12)  1 .032  D(i  ^ , 12) 

From  eqn.  (2.3)  these  calculated  kernels  imply  an  underlying  system 
y(t)  = -2.4  + 0.32x(t)  + 1.032x^(t) 


This  system  exhibits  behavior  which  is  very  different  from  that  of  the 
squarer.  These  values  for  the  kernels  would  cause  approximately  a 5Z  error 


in  the  predicted  output  from  an  input  with  an  amplitude  equal  to  10. 

7 

This  IS  an  instantaneous  power  of  100  corresponding  to  the  o used  in 
calculating  the  kernels.  Notice  that  the  error  increases  as  the 
amplitude  of  the  input  decreases  from  10.  If  a third-order  kernel  had 
been  calculated  the  error  would  also  increase  as  the  amplitude  of  the 
input  increases  from  10.  Therefore,  we  are  still  faced,  as  in  Chapter  III, 
with  the  possibility  of  having  to  calculate  several  sets  of  kernels  using 
various  values  of  o^. 

If  we  were  to  compute  the  kernels  of  the  squarer  using  an  independent 

2 

increment  white  noise  approximation  input  with  o =1,  we  find  that 
var[h^]=0. 002,  var[h^]=0.015,  and  var[h2]=37/2000.  Again  assuming  an 
error  in  each  of  the  kernels  of  plus  one  fourth  standard  deviation,  we  find 

h^.1.01 

h^(T)  - 0.0032  D(t) 

^2^^1 ’ ^2^  ~ ^ 1 ’^2^ 

Notice  that  these  calculated  kernels  imply  an  underlying  system 

y(t)  = -0.022  + 0.0032x(t)  + 1.032x^(t) 

and  with  these  kernels,  the  error  for  an  input  when  its  amplitude  is  1 will 
be  approximately  1.3%.  As  before,  any  additional  higher  order  kernels 
calculated  for  this  system  will  exhibit  errors  which  increase  with 
increasing  amplitude. 

From  the  proceeding  material,  it  is  clear  that  nonlinear  systems  of 
the  form  y(t)=ax"(t)  are  most  amenable  to  reduced  error  calculation  of  low 
order  kernels  if  the  power  of  the  input  probe  x(t)  is  small.  While 


n 


computationally  desirable,  this  niay  not  always  be  physically  practical. 
However,  higher  order  calculated  kernels  will  tend  to  exhibit  larger 
errors  as  the  input  probe  power  is  decreased.  For  systems  which  are 
polynomial  type 

y(t)  = + a^x(t)  + a2X^(t)  + ...  + a^x''{t)  , (4.10) 

for  some  finite  integer  r,  the  error  analysis  becomes  vastly  more 
complicated,  as  errors  in  the  kernels  associated  with  particular  iterated 
products  of  x(t)  may  exhibit  behavior  opposite  that  of  kernels  associated 
with  other  products  of  x(t). 

Marmarelis  (1972)  discusses  the  errors  in  the  calculated  kernels 

associated  with  finite  input  record  lengths  and  gives  a method  for  determining 

the  record  length  L to  insure  that  var[h^]  falls  within  prescribed  'bounds. 

2 

In  view  of  the  exponential  change  in  o of  var[h^-],  we  might  also  wish  to 
investigate  the  use  of  scaling  the  input  probe  to  achieve  more  desirable 
calculated  kernels.  However,  some  reflection  on  this  will  show  that  there 
is  no  advantage  to  scaling  that  is  not  compensated  and  cancelled  when  the 
calculated  kernels  resulting  from  the  scaled  input  probe  are  themselves 
rescaled  appropriately. 
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CHAPTER  V 


PRACTICAL  EXAMPLE 

Some  Wiener  kernels  were  calculated  for  a seismic  energy  propagation 
channel  from  data  which  was  collected  at  Eglin  Air  Force  Base,  Florida. 

The  experimental  arrangement  was  similar  to  that  of  Walker  (1976).  It 
consisted  of  playing  low  frequency  noise  at  various  amplifications  through 
a speaker  in  order  to  stimulate  the  propagation  channel.  The  response 
of  the  propagation  channel  was  then  detected  with  a geophone.  Several 
sets  of  kernels  were  calculated  for  input  probes  at  the  same  amplification 

i 

as  well  as  at  different  amplifications. 

The  noise  was  produced  with  a General  Radio  Company  1381' Random 
Noise  Generator  operating  in  the  2 hertz  to  2,000  hertz  mode.  The  noise 
was  then  low  pass  filtered  to  200  hertz  with  a Tektronics  FG-502  Function 
Generator  and  then  amplified  with  a Sansui  5000A  Power  Amplifier  which  had 
a frequency  response  from  15  hertz  to  20,000  hertz.  At  this  point  the 
signal  was  recorded  on  magnetic  tape  by  an  Ampex  2200  FM  Recorder  which 
had  a frequency  response  of  0 hertz  to  40,000  hertz;  this  record  was  taken 
as  the  input  to  the  system. 

In  addition  to  being  recorded,  the  signal  was  applied  to  an  Altec  416-8A 
Speaker  with  a frequency  response  of  30  hertz  to  1600  hertz  which  was 
attached  to  a plywood  cabinet.  The  cabinet  had  a base  of  approximately 
l‘-5  feet  by  3 feet  and  a height  of  about  3 feet.  The  cabinet  rested  on  the 
ground  with  the  speaker  facing  a point  20  feet  away  where  a Geospace 
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Corporation  Vertical  Axis  Geophone  (Pat.  3119978)  was  buried  at  a depth  of 
12  inches.  The  signal  produced  by  the  geophone  was  also  recorded  on 
magnetic  tape  by  the  Ampex  Recorder  using  a different  channel  on  the  same 
recording  head  as  was  used  to  record  the  input.  This  record  was  taken 
as  the  output  of  the  system.  When  the  experiment  was  completed,  the 
magnetic  records  were  digitized  at  a rate  of  512  samples  per  second. 

Since  the  geophone  does  not  react  when  stimulated  with  a d-c  level, 
the  zeroth-order  Wiener  kernel  is  known  to  be  zero.  The  experimenter  should 
always  attempt  to  take  advantage  of  information  such  as  this  when  making 
a physical  application  of  the  Wiener  theory  as  it  will  reduce  errors  in 
the  modeled  system.  One-half  second  samples  (from  t=  - ^ to  t=  of 
the  first-order  Wiener  kernel  were  calculated.  To  do  this  a one-half 
second  sample  of  the  output  was  cross-correlated  with  a one  second  .sample 
of  the  input  which  began  1/4  second  before  the  output  sample  began  and 
ended  1/4  second  after  the  output  sample  ended. 

Fig.  II  shows  a first-order  kernel  calculated  for  an  input  noise 
probe  with  an  rms  amplitude  of  1/2  volt.  Notice  the  delay  caused  by  the 
propagation  channel.  Fig.  Ill  is  a first-order  kernel  calculated  with 
different  input-output  samples  with  the  input  probe  rms  amplitude  still  equal 
to  1/2  volt.  Fig.  IV  and  Fig.  V are  first-order  kernels  calculated  for 
input  rms  amplitudes  of  1 volt  and  2 volts  respectively.  Fig.  VI  and 
Fig.  VII  are  different  samples  of  the  first-order  kernels  calculated  for 
an  input  rms  amplitude  of  4 volts.  All  of  these  figures  are  scaled  the 
same  and  are  typical  of  the  results  obtained  in  making  the  kernel  calcu- 
lations. 

There  was  generally  more  difference  between  first-order  kernels 
calculated  for  different  input  powers  than  between  different  samples  of 
first-order  kernels  calculated  for  the  same  input  power.  This  indicates 
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the  presence  of  ttie  type  of  ninplitude  dependent  errors  discussed  in  i 

Chapter  III.  Furthermore,  there  was  a greater  variation  in  the  first- 

order  kernels  calculated  for  larger  input  power  than  there  was  in  the  first- 

order  kernels  calculated  with  smaller  input  power.  This  indicates  the 

presence  of  the  type  of  amplitude  dependent  errors  discussed  in  Chapter  IV. 

Neither  of  these  variations  are  great,  however,  and  it  may  be  possible  \ 

to  ignore  them  over  this  range  of  input  amplitudes.  This  would  have  to  | 

1 

be  tested  by  making  output  predictions  with  the  various  kernels  and  | 

J 

I 

noting  whether  or  not  the  variations  in  the  predictions  are  much  larger  than  I 

i 

the  desired  accuracy.  j 

Second-order  kernels  were  also  calculated.  However,  due  to  the  long 
computational  time  involved  in  making  the  calculations  and  the  lack  of 
adequate  two-dimensional  plotting  techniques,  an  insufficient  number  of 
samples  of  the  second-order  kernels  were  obtained  to  state  any  conclusive 
results.  The  calculated  second-order  kernels  did  change  with  the  input 
probe  power,  but  whether  or  not  the  changes  were  significant  or  displayed 
a pattern  could  not  be  determined. 


CHAPTER  VI 
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SUMMARY 

The  Wiener  theory  requires  a system  which  is  to  be  identified  to 
be  probed  with  a zero-mean  Gaussian  white  process.  Practical  considerations 
in  physical  applications  of  the  theory,  however,  require  that  approximations 
of  this  input  probe  be  made.  This  leads  to  errors  which  sometimes  exhibit 
dependencies  upon  the  power  of  the  approximation. 

It  was  shown  in  Chapter  III  that  approximating  a true  white  process 
which  has  infinite  power  with  a finite  power  process  may  result  in  such 

I 

amplitude  dependent  errors  in  the  calculated  kernels.  It  was  here  that 

2 

the  distinction  was  made  between  the  power,  a , of  the  physical  input  probe 

and  the  power  level,  K,  of  the  zero-mean  Gaussian  white  process  it  is 

approximating.  It  was  noted  that  the  true  kernels  are  independent  of  K 

2 

but  the  calculated  kernels  may  still  depend  upon  a . The  resultant 
amplitude  dependent  errors  were  found  to  be  associated  with  certain 
nonlinearities  such  as  thresholds  and  they  can  be  described  for  sane 
simple  cases.  They  were  shown  for  the  particular  case  of  a limiter. 

It  was  shown  in  Chapter  IV  that  approximating  a true  white  process 
which  has  infinite  length  with  a finite  length  process  may  also  result  in 
amplitude  dependent  errors  in  the  calculated  kernels.  These  errors  are 
due  to  the  fact  that  sample  means  of  a random  process  over  finite  intervals 
are  not  generally  equal  to  the  true  mean  of  the  process.  Since  averages 
of  random  processes  are  inherent  in  the  calculation  of  the  Wiener  kernels 
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I 

I 

j 

j the  calculated  kernels  are  only  statistical  estimates  of  the  true  kernels. 

The  variance  of  the  estimated  kernels  gives  a measure  of  their  accuracy. 

The  variance  can  be  estimated  for  simple  nonlinearities,  and  this  was 
done  for  a squarer.  It  was  seen  for  the  more  general  system  y(t)=x'^(t), 
that  the  variances  of  the  kernels  is  proportional  to  where  m is 

the  order  of  the  calculated  kernel. 

j 

If  the  nonlinearities  are  only  slightly  more  complicated  than  those 
which  were  discussed,  error  analysis  using  the  methods  employed  here  would 
be  practically  impossible.  Therefore,  general  results  can  not  really  be 
obtained.  The  experimenter  must  simply  be  aware  that  amplitude  dependent 
errors  do  occur  in  the  calcdlated  Wiener  kernels  and  attempt  to  ascertain 
the  extent  of  their  effect  on  the  kernels  for  each  individual  system 

investigated.  Currently  the  only  method  available  for  accomplishing  this 

1 

is  to  calculate  several  sets  of  kernels  using  different  values  of  o which 
fall  within  the  amplitude  range  of  relevant  inputs  to  the  system  and  noting 
any  changes  which  occur  between  various  sets  of  the  calculated  kernels. 

Note  also  that  none  of  the  simple  nonlinearities  which  were  examined 
had  memory  and  all  had  infinite  bandwidths.  To  get  a better  feel  for 
how  the  amplitude  dependent  errors  affect  the  calculated  kernels  of  a 
physical  system  both  of  these  restrictions  should  have  been  avoided.  Doing 
so,  however,  vastly  complicates  the  problem  and  simply  was  not  practical 
in  this  analysis.  There  is  an  obvious  need  for  better  means  of  assessing 
amplitude  dependent  errors  parametrically  with  the  bandwidth,  memory,  and 
dynamic  range  of  the  system.  Also,  extending  this  analysis  into  the 
frequency  domain  may  prove  useful  in  physical  applications  of  the  Wiener 
theory. 
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